Papers with encoder network
Extracting Topics with Simultaneous Word Co-occurrence and Semantic Correlation Graphs: Neural Topic Modeling for Short Texts (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Empirical results validate that DWGTM can generate more semantically coherent topics than baseline topic models. |
| Approach: | They develop a neural topic model which extracts topics from word co-occurrence graphs . Empirical results validate that DWGTM can generate more semantically coherent topics than baseline topic models. |
| Outcome: | Empirical results show that the proposed model can generate more coherent topics than baseline topic models. |
Pre-trained language model representations for language generation (N19-1)
Copied to clipboard
| Challenge: | Pre-trained language model representations have been successful in a wide range of language understanding tasks. |
| Approach: | They propose to use pre-trained language model representations to integrate them into sequence to sequence models and apply it to machine translation and abstractive summarization. |
| Outcome: | The proposed model is able to perform 5.3 BLEU in machine translation and 5.3 on the full text version of CNN/DailyMail. |
Neural Topic Modeling with Cycle-Consistent Adversarial Training (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances on deep generative models have attracted significant interest in neural topic modeling. |
| Approach: | They propose an adversarial-neural topic model which uses Dirichlet prior to capture the semantic patterns in latent topics. |
| Outcome: | The proposed models outperform competing models on unsupervised/supervised topic modeling and text classification. |